Advances on the Transcription of Historical Manuscripts based on Multimodality, Interactivity and Crowdsourcing

Natural Language Processing (NLP) is an interdisciplinary research field of Computer Science, Linguistics, and Pattern Recognition that studies, among others, the use of human natural languages in Human-Computer Interaction (HCI). Most of NLP research tasks can be applied for solving real-world problems. This is the case of natural language recognition and natural language translation, that can be used for building automatic systems for document transcription and document translation. Regarding digitalised handwritten text documents, transcription is used to obtain an easy digital access to the contents, since simple image digitalisation only provides, in most cases, search by image and not by linguistic contents (keywords, expressions, syntactic or semantic categories). Transcription is even more important in historical manuscripts, since most of these documents are unique and the preservation of their contents is crucial for cultural and historical reasons. The transcription of historical manuscripts is usually done by paleographers, who are experts on ancient script and vocabulary. Recently, Handwritten Text Recognition (HTR) has become a common tool for assisting paleographers in their task, by providing a draft transcription that they may amend with more or less sophisticated methods. This draft transcription is useful when it presents an error rate low enough to make the amending process more comfortable than a complete transcription from scratch. Thus, obtaining a draft transcription with an acceptable low error rate is crucial to have this NLP technology incorporated into the transcription process. The work described in this thesis is focused on the improvement of the draft transcription offered by an HTR system, with the aim of reducing the effort made by paleographers for obtaining the actual transcription on digitalised historical manuscripts. This problem is faced from three different, but complementary, scenarios: · Multimodality: The use of HTR systems allow paleographers to speed up the manual transcription process, since they are able to correct on a draft transcription. Another alternative is to obtain the draft transcription by dictating the contents to an Automatic Speech Recognition (ASR) system. When both sources (image and speech) are available, a multimodal combination is possible and an iterative process can be used in order to refine the final hypothesis. · Interactivity: The use of assistive technologies in the transcription process allows one to reduce the time and human effort required for obtaining the actual transcription, given that the assistive system and the palaeographer cooperate to generate a perfect transcription. Multimodal feedback can be used to provide the assistive system with additional sources of information by using signals that represent the whole same sequence of words to transcribe (e.g. a text image, and the speech of the dictation of the contents of this text image), or that represent just a word or character to correct (e.g. an on-line handwritten word). · Crowdsourcing: Open distributed collaboration emerges as a powerful tool for massive transcription at a relatively low cost, since the paleographer supervision effort may be dramatically reduced. Multimodal combination allows one to use the speech dictation of handwritten text lines in a multimodal crowdsourcing platform, where collaborators may provide their speech by using their own mobile device instead of using desktop or laptop computers, which makes it possible to recruit more collaborators.El Procesamiento del Lenguaje Natural (PLN) es un campo de investigación interdisciplinar de las Ciencias de la Computación, Lingüística y Reconocimiento de Patrones que estudia, entre otros, el uso del lenguaje natural humano en la interacción Hombre-Máquina. La mayoría de las tareas de investigación del PLN se pueden aplicar para resolver problemas del mundo real. Este es el caso del reconocimiento y la traducción del lenguaje natural, que se pueden utilizar para construir sistemas automáticos para la transcripción y traducción de documentos. En cuanto a los documentos manuscritos digitalizados, la transcripción se utiliza para facilitar el acceso digital a los contenidos, ya que la simple digitalización de imágenes sólo proporciona, en la mayoría de los casos, la búsqueda por imagen y no por contenidos lingüísticos. La transcripción es aún más importante en el caso de los manuscritos históricos, ya que la mayoría de estos documentos son únicos y la preservación de su contenido es crucial por razones culturales e históricas. La transcripción de manuscritos históricos suele ser realizada por paleógrafos, que son personas expertas en escritura y vocabulario antiguos. Recientemente, los sistemas de Reconocimiento de Escritura (RES) se han convertido en una herramienta común para ayudar a los paleógrafos en su tarea, la cual proporciona un borrador de la transcripción que los paleógrafos pueden corregir con métodos más o menos sofisticados. Este borrador de transcripción es útil cuando presenta una tasa de error suficientemente reducida para que el proceso de corrección sea más cómodo que una completa transcripción desde cero. Por lo tanto, la obtención de un borrador de transcripción con una baja tasa de error es crucial para que esta tecnología de PLN sea incorporada en el proceso de transcripción. El trabajo descrito en esta tesis se centra en la mejora del borrador de transcripción ofrecido por un sistema RES, con el objetivo de reducir el esfuerzo realizado por los paleógrafos para obtener la transcripción de manuscritos históricos digitalizados. Este problema se enfrenta a partir de tres escenarios diferentes, pero complementarios: · Multimodalidad: El uso de sistemas RES permite a los paleógrafos acelerar el proceso de transcripción manual, ya que son capaces de corregir en un borrador de la transcripción. Otra alternativa es obtener el borrador de la transcripción dictando el contenido a un sistema de Reconocimiento Automático de Habla. Cuando ambas fuentes están disponibles, una combinación multimodal de las mismas es posible y se puede realizar un proceso iterativo para refinar la hipótesis final. · Interactividad: El uso de tecnologías asistenciales en el proceso de transcripción permite reducir el tiempo y el esfuerzo humano requeridos para obtener la transcripción correcta, gracias a la cooperación entre el sistema asistencial y el paleógrafo para obtener la transcripción perfecta. La realimentación multimodal se puede utilizar en el sistema asistencial para proporcionar otras fuentes de información adicionales con señales que representen la misma secuencia de palabras a transcribir (por ejemplo, una imagen de texto, o la señal de habla del dictado del contenido de dicha imagen de texto), o señales que representen sólo una palabra o carácter a corregir (por ejemplo, una palabra manuscrita mediante una pantalla táctil). · Crowdsourcing: La colaboración distribuida y abierta surge como una poderosa herramienta para la transcripción masiva a un costo relativamente bajo, ya que el esfuerzo de supervisión de los paleógrafos puede ser drásticamente reducido. La combinación multimodal permite utilizar el dictado del contenido de líneas de texto manuscrito en una plataforma de crowdsourcing multimodal, donde los colaboradores pueden proporcionar las muestras de habla utilizando su propio dispositivo móvil en lugar de usar ordenadores,El Processament del Llenguatge Natural (PLN) és un camp de recerca interdisciplinar de les Ciències de la Computació, la Lingüística i el Reconeixement de Patrons que estudia, entre d'altres, l'ús del llenguatge natural humà en la interacció Home-Màquina. La majoria de les tasques de recerca del PLN es poden aplicar per resoldre problemes del món real. Aquest és el cas del reconeixement i la traducció del llenguatge natural, que es poden utilitzar per construir sistemes automàtics per a la transcripció i traducció de documents. Quant als documents manuscrits digitalitzats, la transcripció s'utilitza per facilitar l'accés digital als continguts, ja que la simple digitalització d'imatges només proporciona, en la majoria dels casos, la cerca per imatge i no per continguts lingüístics (paraules clau, expressions, categories sintàctiques o semàntiques). La transcripció és encara més important en el cas dels manuscrits històrics, ja que la majoria d'aquests documents són únics i la preservació del seu contingut és crucial per raons culturals i històriques. La transcripció de manuscrits històrics sol ser realitzada per paleògrafs, els quals són persones expertes en escriptura i vocabulari antics. Recentment, els sistemes de Reconeixement d'Escriptura (RES) s'han convertit en una eina comuna per ajudar els paleògrafs en la seua tasca, la qual proporciona un esborrany de la transcripció que els paleògrafs poden esmenar amb mètodes més o menys sofisticats. Aquest esborrany de transcripció és útil quan presenta una taxa d'error prou reduïda perquè el procés de correcció siga més còmode que una completa transcripció des de zero. Per tant, l'obtenció d'un esborrany de transcripció amb un baixa taxa d'error és crucial perquè aquesta tecnologia del PLN siga incorporada en el procés de transcripció. El treball descrit en aquesta tesi se centra en la millora de l'esborrany de la transcripció ofert per un sistema RES, amb l'objectiu de reduir l'esforç realitzat pels paleògrafs per obtenir la transcripció de manuscrits històrics digitalitzats. Aquest problema s'enfronta a partir de tres escenaris diferents, però complementaris: · Multimodalitat: L'ús de sistemes RES permet als paleògrafs accelerar el procés de transcripció manual, ja que són capaços de corregir un esborrany de la transcripció. Una altra alternativa és obtenir l'esborrany de la transcripció dictant el contingut a un sistema de Reconeixement Automàtic de la Parla. Quan les dues fonts (imatge i parla) estan disponibles, una combinació multimodal és possible i es pot realitzar un procés iteratiu per refinar la hipòtesi final. · Interactivitat: L'ús de tecnologies assistencials en el procés de transcripció permet reduir el temps i l'esforç humà requerits per obtenir la transcripció real, gràcies a la cooperació entre el sistema assistencial i el paleògraf per obtenir la transcripció perfecta. La realimentació multimodal es pot utilitzar en el sistema assistencial per proporcionar fonts d'informació addicionals amb senyals que representen la mateixa seqüencia de paraules a transcriure (per exemple, una imatge de text, o el senyal de parla del dictat del contingut d'aquesta imatge de text), o senyals que representen només una paraula o caràcter a corregir (per exemple, una paraula manuscrita mitjançant una pantalla tàctil). · Crowdsourcing: La col·laboració distribuïda i oberta sorgeix com una poderosa eina per a la transcripció massiva a un cost relativament baix, ja que l'esforç de supervisió dels paleògrafs pot ser reduït dràsticament. La combinació multimodal permet utilitzar el dictat del contingut de línies de text manuscrit en una plataforma de crowdsourcing multimodal, on els col·laboradors poden proporcionar les mostres de parla utilitzant el seu propi dispositiu mòbil en lloc d'utilitzar ordinadors d'escriptori o portàtils, la qual cosa permet ampliar el nombrGranell Romero, E. (2017). Advances on the Transcription of Historical Manuscripts based on Multimodality, Interactivity and Crowdsourcing [Tesis doctoral no publicada]. Universitat Politècnica de València. https://doi.org/10.4995/Thesis/10251/86137TESI

Multimodal Crowdsourcing for Transcribing Handwritten Documents

© 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.[EN] Transcription of handwritten documents is an important research topic for multiple applications, such as document classification or information extraction. In the case of historical documents, their transcription allows to preserve cultural heritage because of the amount of historical data contained in those documents. The transcription process can employ state-of-the-art handwritten text recognition systems in order to obtain an initial transcription. This transcription is usually not good enough for the quality standards, but that may speed up the final transcription of the expert. In this framework, the use of collaborative transcription applications (crowdsourcing) has risen in the recent years, but these platforms are mainly limited by the use of non-mobile devices. Thus, the recruiting initiatives get reduced to a smaller set of potential volunteers. In this paper, an alternative that allows the use of mobile devices is presented. The proposal consists of using speech dictation of handwritten text lines. Then, by using multimodal combination of speech and handwritten text images, a draft transcription can be obtained, presenting more quality than that obtained by only using handwritten text recognition. The speech dictation platform is implemented as a mobile device application, which allows for a wider range of population for recruiting volunteers. A real acquisition on the contents of a Spanish historical handwritten book was obtained with the platform. This data was used to perform experiments on the behaviour of the proposed framework. Some experiments were performed to study how to optimise the collaborators effort in terms of number of collaborations, including how many lines and which lines should be selected for the speech dictation.This work was supported in part by projects READ-674943 (European Union's H2020), SmartWays-RTC-2014-1466-4 (MINECO), CoMUN-HaT-TIN2015-70924-C2-1-R (MINECO/FEDER), and ALMAMATER-PROMETEOII/2014/030 (Generalitat Valenciana).Granell Romero, E.; Martínez Hinarejos, CD. (2017). Multimodal Crowdsourcing for Transcribing Handwritten Documents. IEEE/ACM Transactions on Audio, Speech and Language Processing. 25(2):409-419. https://doi.org/10.1109/TASLP.2016.2634123S40941925

Multimodality, interactivity, and crowdsourcing for document transcription

This is the peer reviewed version of the following article: Granell, Emilio, Romero, Verónica, Martínez-Hinarejos, Carlos-D.. (2018). Multimodality, interactivity, and crowdsourcing for document transcription.Computational Intelligence, 34, 2, 398-419. DOI: 10.1111/coin.12169, which has been published in final form at http://doi.org/10.1111/coin.12169.. This article may be used for non-commercial purposes in accordance with Wiley Terms and Conditions for Self-Archiving.[EN] Knowledge mining from documents usually use document engineering techniques that allow the user to access the information contained in documents of interest. In this framework, transcription may provide efficient access to the contents of handwritten documents. Manual transcription is a time-consuming task that can be sped up by using different mechanisms. A first possibility is employing state-of-the-art handwritten text recognition systems to obtain an initial draft transcription that can be manually amended. A second option is employing crowdsourcing to obtain a massive but not error-free draft transcription. In this case, when collaborators employ mobile devices, speech dictation can be used as a transcription source, and speech and handwritten text recognition can be fused to provide a better draft transcription, which can be amended with even less effort. A final option is using interactive assistive frameworks, where the automatic system that provides the draft transcription and the transcriber cooperate to generate the final transcription. The novel contributions presented in this work include the study of the data fusion on a multimodal crowdsourcing framework and its integration with an interactive system. The use of the proposed solutions reduces the required transcription effort and optimizes the overall performance and usability, allowing for a better transcription process.projects READ, Grant/Award Number: 674943; (European Union's H2020); Smart Ways, Grant/Award Number: RTC-2014-1466-4; (MINECO); CoMUN-HaT, Grant/Award Number: TIN2015-70924-C2-1-R; (MINECO / FEDER)Granell, E.; Romero, V.; Martínez-Hinarejos, C. (2018). Multimodality, interactivity, and crowdsourcing for document transcription. Computational Intelligence. 34(2):398-419. https://doi.org/10.1111/coin.12169S39841934

Image speech combination for interactive computer assisted transcription of handwritten documents

[EN] Handwritten document transcription aims to obtain the contents of a document to provide efficient information access to, among other, digitised historical documents. The increasing number of historical documents published by libraries and archives makes this an important task. In this context, the use of image processing and understanding techniques in conjunction with assistive technologies reduces the time and human effort required for obtaining the final perfect transcription. The assistive transcription system proposes a hypothesis, usually derived from a recognition process of the handwritten text image. Then, the professional transcriber feedback can be used to obtain an improved hypothesis and speed-up the final transcription. In this framework, a speech signal corresponding to the dictation of the handwritten text can be used as an additional source of information. This multimodal approach, that combines the image of the handwritten text with the speech of the dictation of its contents, could make better the hypotheses (initial and improved) offered to the transcriber. In this paper we study the feasibility of a multimodal interactive transcription system for an assistive paradigm known as Computer Assisted Transcription of Text Images. Different techniques are tested for obtaining the multimodal combination in this framework. The use of the proposed multimodal approach reveals a significant reduction of transcription effort with some multimodal combination techniques, allowing for a faster transcription process.Work partially supported by projects READ-674943 (European Union's H2020), SmartWays-RTC-2014-1466-4 (MINECO, Spain), and CoMUN-HaT-TIN2015-70924-C2-1-R (MINECO/FEDER), and by Generalitat Valenciana (GVA), Spain under reference PROMETEOII/2014/030.Granell, E.; Romero, V.; Martínez-Hinarejos, C. (2019). Image speech combination for interactive computer assisted transcription of handwritten documents. Computer Vision and Image Understanding. 180:74-83. https://doi.org/10.1016/j.cviu.2019.01.009S748318

Smart Collaborative Mobile System for Taking Care of Disabled and Elderly People

Official statistics data show that in many countries the population is aging. In addition, there are several illnesses and disabilities that also affect a small sector of the population. In recent years, researchers and medical foundations are working in order to develop systems based on new technologies and enhance the quality of life of them. One of the cheapest ways is to take advantage of the features provided by the smartphones. Nowadays, the development of reduced size smartphones, but with high processing capacity, has increased dramatically. We can take profit of the sensors placed in smartphones in order to monitor disabled and elderly people. In this paper, we propose a smart collaborative system based on the sensors embedded in mobile devices, which permit us to monitor the status of a person based on what is happening in the environment, but comparing and taking decisions based on what is happening to its neighbors. The proposed protocol for the mobile ad hoc network and the smart system algorithm are described in detail. We provide some measurements showing the decisions taken for several common cases and we also show the performance of our proposal when there is a medium size group of disabled or elderly people. Our proposal can also be applied to take care of children in several situations.This work has been partially supported by the Instituto de Telecomunicacoes, Next Generation Networks and Applications Group (NetGNA), Portugal, and by National Funding from the FCT - Fundacao para a Ciencia e a Tecnologia through the PEst-OE/EEI/LA0008/2011 Project.Sendra Compte, S.; Granell Romero, E.; Lloret, J.; Rodrigues, JJPC. (2014). Smart Collaborative Mobile System for Taking Care of Disabled and Elderly People. Mobile Networks and Applications. 19(3):287-302. doi:10.1007/s11036-013-0445-zS287302193Cisco Systems Inc. “Cisco Visual Networking Index: Global Mobile Data Traffic Forecast Update, 2010–2015.” White Paper, February 1, 2011Pereira O, Caldeira J, Rodrigues J (2011) Body sensor network mobile solutions for biofeedback monitoring. J Mob Netw Appl 16(6):713–732Google. Galaxy nexus (2012). Available: http://www.google.com/nexus/E. Commission. “Demography report 2010.” Eurostat, the Statistical Office of the European Union, 2010. At http://ec.europa.eu/social/BlobServlet?docId=6824&langId=enThomas KE, Stevens JA, Sarmiento K, Wald MM (2008) Fall-related traumatic brain injury deaths and hospitalizations among older adults—United States, 2005. J Saf Res 39(3):269–272Fortino G, Giannantonio R, Gravina R, Kuryloski P, Jafari R, (2013) Enabling effective programming and flexible management of efficient body sensor network applications. IEEE Trans Hum Mach Syst 43(1):115–133Bellifemine F, Fortino G, Giannantonio R, Gravina R, Guerrieri A, Sgroi M (2011) SPINE: a domain-specific framework for rapid prototyping of WBSN applications. Softw Pract Exper 41(3):237–265Macias E, Lloret J, Suarez A, Garcia M (2012) Architecture and protocol of a semantic system designed for video tagging with sensor data in mobile devices. Sensors 12(2):2062–2087Sendra S, Granell E, Lloret J, Rodrigues JJPC. Smart Collaborative System Using the Sensors of Mobile Devices for Monitoring Disabled and Elderly People, 3rd IEEE International Workshop on Smart Communications in Network Technologies, Ottawa, Canada, June 11, 2012Lane N, Miluzzo E, Lu H, Peebles D, Choudhury T, Campbell A (2010) A survey of mobile phone sensing. IEEE Commun Mag 48(9):140–150Muldoon C, OHare G, OGrady M (2006) Collaborative agent tuning: Performance enhancement on mobile devices Engineering Societies in the Agents World VI, Lecture Notes in Computer Science, Volume 3963/2006, pp 241–258Turner H, White J, Thompson C, Zienkiewicz K, Campbell S, Schmidt DC (2009) Building Mobile Sensor Networks Using Smartphones and Web Services: Ramifications and Development Challenges, Handbook of Research on Mobility and Computing, Hershey, PA. Available: http://lsrg.cs.wustl.edu/~schmidt/PDF/new-ww-mobile-computing.pdfKansal A, Goraczko M, Zhao F. Building a sensor network of mobile phones, 6th International Conference on Information Processing in Sensor Networks. Cambridge, Massachusetts, USA, April 24–27, 2007 pp 547–548Plaza I, Martín L, Martin S, Medrano C (2011) Mobile applications in an aging society: status and trends. J Syst Softw 84(11):1977–1988Camarinha-Matos L, Afsarmanesh H. Telecare: Collaborative virtual elderly support communities, 1st Workshop on Tele-Care and Collaborative Virtual Communities in Elderly Care, Porto, Portugal, 13 April, 2004Chen B, Pompili D (2011) Transmission of patient vital signs using wireless body area networks. J Mob Netw Appl 16(6):663–682Dai J, Bai X, Yang Z, Shen Z, Xuan D (2010) Mobile phone-based pervasive fall detection. Pers Ubiquit Comput 14(7):633–643Martin P, Sánchez MA, Álvarez L, Alonso V, Bajo J. Multiagent system for detecting elderly people falls through mobile devices, International Symposium on Ambient Intelligence (ISAmI’11), Salamanca (Spain) 6–8 April 2011Fahmi PN, Viet V, Deok-Jai C. “Semi-supervised fall detection algorithm using fall indicators in smartphone.” Proceedings of the 6th International Conference on Ubiquitous Information Management and Communication, 2012, pp 122Sánchez M, Martín P, Álvarez L, Alonso V, Zato C, Pedrero A, Bajo J (2011) A New Adaptive Algorithm for Detecting Falls through Mobile Devices, Trends in Practical Applications of Agents and Multiagent Systems, pp 17–24Fahim M, Fatima I, Lee S, Lee YK. Daily Life Activity Tracking Application for Smart Homes using Android Smartphone, 14th International Conference on Advanced Communication Technology, Yongin, South Korea, 19–22 February 2012, pp 241–245Kaluža B, Mirchevska V, Dovgan E, Luštrek M, Gams M (2010) An agent-based approach to care in independent living, Ambient Intelligence, Lecture Notes in Computer Science, vol. 6439, pp 177–186Costa A, Barbosa G, Melo T, Novais P (2011) Using mobile systems to monitor an ambulatory patient. In: International Symposium on Distributed Computing and Artificial Intelligence, Advances in Intelligent and Soft Computing, vol. 91, pp 337–344Olfati-Saber R, Fax J, Murray R (2007) Consensus and cooperation in networked multi-agent systems. Proc IEEE 95(1):215–233Arcelus A, Jones MH, Goubran R, Knoefel F (2007) Integration of smart home technologies in a health monitoring system for the elderly, 21st International Conference on Advanced Information Networking and Applications Workshops, vol. 2, pp 820–825Kahmen H, Faig W (1988) Surveying. Walter de Gruyter & Co, New YorkSol LM870 mobile phone features. Available at: http://es.made-in-china.com/co_runrise/product_Dual-SIM-Card-Dual-Standby-GPS-Temperature-UV-Sensor-Pedometer-Sunrise-LM870-Mobile-Phone_hesighyiy.htmlSTLM20 temperature sensor features. Datashhet available at: http://www.st.com/internet/com/TECHNICAL_RESOURCES/TECHNICAL_LITERATURE/DATASHEET/CD00119601.pdfSendra S, Lloret J, Garcia M, Toledo JF (2011) Power saving and energy optimization techniques for wireless sensor networks. J Commun 6(6):439–459Matlab Website. Available at: www.mathworks.com/products/matlabPal A (2010) Localization algorithms in wireless sensor networks: current approaches and future challenges. Netw Protocol Algorithm 2(1):45–74Garcia M, Boronat F, Tomás J, Lloret J (2009) The development of two systems for indoor wireless sensors self-location. Ad Hoc Sensor Wirel Netw 8(3–4):235–258Lloret J, Tomás J, Garcia M, Cánovas A (2009) A hybrid stochastic approach for self-location of wireless sensors in indoor environments. Sensors 9(5):3695–3712Garcia M, Sendra S, Turro C, Lloret J (2011) User’s macro and micro-mobility study using WLANs in a university campus. Int J Adv Internet Technol 4(1&2):37–46Lloret J, Tomas J, Canovas A, Bellver I. GeoWiFi: A Geopositioning System Based on WiFi Networks, The Seventh International Conference on Networking and Services (ICNS 2011), Venice (Italy), May 6–10, 2011Yu W, Su X, Hansen J (2012) A smartphone design approach to user communication interface for administering storage system network. Netw Protoc Algorithm 4(4):126–15

IEEE 802.11g Radio Coverage Study for Indoor Wireless Network Redesign

An efficient wireless design and development is essential to ensure a good performance of the WLANs. It supposes a good estimation of the number of APs, their locations according to the structure of the building, a good channel distribution and an adequate level of transmission power in order to avoid overlapping but providing the largest coverage. Otherwise, a WLAN may be composed by more access points, so it may be more expensive, but with a worse function due to the radio overlapping among APs in the same channel. In this paper, we show how a WLAN can be redesigned in order to improve its wireless coverage and function. It is based on studying the distribution and features of a public building in a Spanish University in order to determine the optimum access point location and to assign the appropriated channel. In this case, this WLAN allows users to connect to one of the available SSIDs in the target building. Results obtained from the proposed redesign have been very successful from the point of view of performance and coverage.Sendra, S.; Bri Molinero, D.; Granell Romero, E.; Lloret, J. (2012). IEEE 802.11g Radio Coverage Study for Indoor Wireless Network Redesign. International Journal on Advances in Intelligent Systems. 5(4):518-532. http://hdl.handle.net/10251/47031S5185325

Mobilization of xanthine oxidase from the gastrointestinal tract in acute pancreatitis

BACKGROUND: Xanthine oxidoreductase has been proposed to play a role in the development of local and systemic effects of acute pancreatitis. Under physiologic conditions, the enzyme exists mainly as xanthine dehydrogenase (XDH) but can be converted by proteolytic cleavage to its superoxide-generating form xanthine oxidase (XOD). In addition to its intracellular location XDH/XOD is also associated to the polysaccharide chains of proteoglycans on the external endothelial cell membrane. In the early stages of acute pancreatitis, this enzyme seems to be arising from its mobilization from the gastrointestinal endothelial cell surface. Taking into account the ability of α-amylase to hydrolyze the internal α-1,4 linkages of polysaccharides, we wanted to elucidate the involvement of α-amylase in XDH/XOD mobilization from the gastrointestinal endothelial cell surface and the relevance of the ascitic fluid (AF) as the source of α-amylase in experimental acute pancreatitis. METHODS: Acute pancreatitis was induced in male Wistar rats by intraductal administration of 5% sodium taurocholate. In another experimental group 3000 U/Kg α-amylase was i.v. administered. The concentrations of XDH, XOD and α-amylase in plasma and AF and myeloperoxidase (MPO) in lung have been evaluated. In additional experiments, the effect of peritoneal lavage and the absorption of α-amylase present in the AF by an isolated intestine have been determined. RESULTS: Similar increase in XDH+XOD activity in plasma was observed after induction of acute pancreatitis and after i.v. administration of α-amylase. Nevertheless, the conversion from XDH to XOD was only observed in the pancreatitis group. Lung inflammation measured as MPO activity was observed only in the pancreatitis group. In addition peritoneal lavage prevented the increase in α-amylase and XDH+XOD in plasma after induction of pancreatitis. Finally, it was observed that α-amylase is absorbed from the AF by the intestine. CONCLUSIONS: During the early stages of acute pancreatitis, α-amylase absorbed from AF through the gastrointestinal tract could interfere with the binding of XDH/XOD attached to glycoproteins of the endothelial cells. Proteolytic enzymes convert XDH into its oxidase form promoting an increase in circulating XOD that has been reported to be one of the mechanisms involved in the triggering of the systemic inflammatory process

Planificación estratégica para el juego Diplomacy

El objetivo principal de la inteligencia artificial es construir modelos computacionales capaces de razonar como lo hacemos los humanos. Uno de sus campos de desarrollo es la planificación automática. Esta fascinante disciplina permite generar computacionalmente planes de acción para lograr objetivos específicos en entornos complejos en los que para los seres humanos sería muy difícil generarlos adecuadamente. La planificación automática se puede desarrollar mediante diferentes técnicas de razonamiento. La planificación automática basada en razonamiento deductivo tiene el problema de que las decisiones están limitadas a las tareas concretas para las que el sistema fue pre-programado. Por otro lado, el utilizar técnicas de razonamiento inductivo como son los Procesos de Decisión de Markov en la planificación automática, permite crear sistemas inteligentes capaces de adaptarse a su entorno. En esta tesis presentamos la aplicación de diferentes técnicas de inteligencia artificial y planificación automática en un bot capaz de jugar a Diplomacy mediante inferencias deductivas e inductivas, aprendiendo de su propia experiencia como jugador. En nuestro bot el razonamiento deductivo está basado en el estudio de los bots existentes y el razonamiento inductivo está basado en los Procesos de Decisión de Markov. Dado que por la naturaleza de Diplomacy no se pueden conocer las probabilidades de transición entre estados, se ha aplicado la técnica de aprendizaje por refuerzo Q-Learning para actualizar los valores de utilidad. Mediante la experimentación se demuestra que el razonamiento inductivo complementa al razonamiento deductivo haciendo que el rendimiento del bot mejore a medida que aprende.Granell Romero, E. (2011). Planificación estratégica para el juego Diplomacy. http://hdl.handle.net/10251/1274

Desarrollo de un sistema de reconocimiento del habla distribuido basado en Android

En este trabajo se presenta un sistema de interpretacion automatica distribuido. Este sistema está compuesto por una aplicación cliente desarrollada para dispositivos móviles con sistema operativo Android, que interactúa con los usuarios, y un servidor encargado de las tatreas automáticas de reconocimiento del habla y traducción. El dominio de interpretación está limitado a una tarea concreta basada en la interacción que un turista podría tener a su llegada a un hotel. Nuestro sistema es capaz de traducir frases habituales en una comunicación oral en la recepción de un hotel del castellano al inglés. In this work we present a distributed system for automatic interpretation. This system consists of a client application developed for mobile devices with Android operating system, which interacts with users, and a server dedicated to the automatic speech recognition and machine translation. The domain of interpretation is limited to a particular task based in the interaction that a tourist may have on arrival at a hotel. Our system is able to translate standard sentences in oral communication at the reception of a hotel from Spanish into English.Granell Romero, E. (2012). Desarrollo de un sistema de reconocimiento del habla distribuido basado en Android. Universitat Politècnica de València. http://hdl.handle.net/10251/15275Archivo delegad

Study of the influence of lexicon and language restrictions on computer assisted transcription of historical manuscripts

[EN] State-of-the-art Handwritten Text Recognition (HTR) systems allow transcribers to speed-up the transcription of handwritten text images. These systems provide transcribers an initial draft transcription that can be corrected with less effort than transcribing the handwritten text images from scratch. Currently, even the draft transcriptions offered by the most advanced HTR systems contain errors. Therefore, the supervision of this draft by a human transcriber is still necessary to obtain the correct transcription of the handwritten text images. This supervision can be eased by using interactive and assistive transcription systems, where the transcriber and the automatic system cooperate in the amending process. In this paper, the draft transcription is provided by an HTR system based on Convolutional and Recurrent Neural Networks with Bidirectional Long-Short Term Memory units, and the assistive system is fed by lattices generated by using Weighted Finite State Transducers. The influence of the lexicon and language restrictions on the performance of our computer assisted transcription system is evaluated on three historical manuscripts. The transcriptions offered by the proposed HTR system present very low error rates for the studied historical manuscripts. However, our assistive transcription system without lexicon or language restrictions is able to provide an additional reduction on the human effort required to correct the transcriptions in more than 50% over the transcriptions offered by the HTR system. (C) 2020 Elsevier B.V. All rights reserved.Work partially supported by the BBVA Foundation through the 2017-2018 Digital Humanities research grant "Carabela" and the grant "Ayudas Fundacion BBVA a equipos de investigacion cientifica 2018"(PR[18]_HUM_C2_0087), by the Generalitat Valenciana under the EU-FEDER Comunitat Valenciana 2014-2020 grant IDIFEDER/2018/025 "Sistemas de fabricacion inteligente para la industria 4.0"and the grant PROMETEO/2019/121 (DeepPattern), and by the Ministerio de Ciencia/AEI/FEDER/EU through the MIRANDA-DocTIUM project (RTI2018-095645-B-C22)Granell, E.; Romero, V.; Martínez-Hinarejos, C. (2020). Study of the influence of lexicon and language restrictions on computer assisted transcription of historical manuscripts. Neurocomputing. 390:12-27. https://doi.org/10.1016/j.neucom.2020.01.081S122739